PALM-3184/ACM/JSG 



United States Patent Application 
For 

VARIABLE TEMPLATE INPUT AREA FOR A DATA INPUT DEVICE OF A HANDHELD 

FLECTRONIC SYSTEM 



Inventors: 

Eric Michael Lunsford 
Bruce Woodworth 
John Cook 
Amy Han 



Prepared by: 

WAGNER, MURABITO & HAO LLP 
Two North Market Street 
Third Floor 
San Jose, California 95113 

(408) 938-9060 



CONFIDENTIAL 



VARIABLE TEMPLATE INPUT AREA FOR A DATA INPUT DEVICE OF A HANDHELD 

ELECTRONIC SYSTEM 

5 

BACKGROUND OF THE INVENTION 
FIELD OF THE INVENTION 

The present invention generally relates to the field of data input devices. More 
particularly, the present invention relates to the field of multi-functional data input 

1 0 devices. 

O 

y RELATED ART 

fy Computer systems and other electronic systems or devices (e.g., personal 

03 

digital assistants) have become integral tools used in a wide variety of different 

O 

applications, such as in finance and commercial transactions, computer-aided design 
^ and manufacturing, health care, telecommunication, education, etc. Computers along 
w with other electronic devices are finding new applications as a result of advances in 
hardware technology and rapid development in software technology. Furthermore, the 
functionality of computer systems is dramatically enhanced by coupling these stand- 
20 alone computer systems together in order to form a networking environment. Within a 
networking environment, users may readily exchange files, share information stored 
on a common database, pool resources, and communicate via electronic mail (e-mail) 
and via video teleconferencing. Furthermore, computer systems or other types of 
electronic devices which are coupled to the Internet provide their users access to data 
25 and information from all over the world. 
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A personal digital assistant (commonly referred to as a PDA) is a portable 
computer system. It is appreciated that the personal digital assistant is a portable 
handheld device that is used as an electronic organizer which has the capability to 
5 store a wide range of information that includes daily appointments, numerous 
telephone numbers of business and personal acquaintances, and various other 
information. Furthermore, the personal digital assistant has the ability to connect to a 
personal computer system, enabling the two devices to exchange updated 

5 information. Additionally, the personal digital assistant can also be connected to a 

Si 

H 0 modem, enabling it to have electronic mail (e-mail) capabilities over the Internet along 

W 

p. with other Internet capabilities. Moreover, an advanced personal digital assistant can 

; i : 

5 W 

^ have Internet capabilities over a wireless communication interface (e.g., radio 
3 interface). Also, the personal digital assistant can be coupled to a networking 
O environment. 

Typically, the personal digital assistant includes a data input device such as a 
handwriting recognition device which can be utilized to control and operate the 
personal digital assistant. The handwriting recognition device receives user input 
handwriting stroke data, whereas a user utilizes a stylus to stroke alphanumeric 
20 characters and analog characters (e.g., *,&,©, $, etc.) on the handwriting recognition 
device. The handwriting recognition device processes the user input handwriting 
stroke data and transmits the processed data to another component (e.g., an electronic 
display device, a memory unit, a processor, etc.) of the personal digital assistant so 
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that a particular operation or function can be performed. Personal digital assistants 
are enormously popular, in part because of their handwriting recognition device. 

However, the handwriting recognition device is not the ideal input mechanism 
5 for everyone. In fact, many potential users have elected not to purchase a personal 
digital assistant precisely because they reject this data input method for various 
reasons. Some potential users simply do not understand how the handwriting 
^ recognition device interfaces with the user. Other potential users have experimented 
A? with the handwriting recognition device, but have been left frustrated by not being able 
W t0 9 et the handwriting recognition device to work right away, leaving them with the 
fy impression that the handwriting recognition device does not work. Moreover, some 
^ potential users believe that their own handwriting is too hard for a human to read, 
/J much less a handwriting recognition device. Other potential users doubt that any form 
□ of handwriting recognition really works, believing the handwriting recognition device is 
15 too error-prone. This resistance directed at the handwriting recognition device has led 
to lost opportunities for new sales and new users for the personal digital assistant. 

To appeal to potential users, a software keyboard has been incorporated into 
the personal digital assistant. The software keyboard is displayed on the touch- 
20 sensitive electronic display device of the personal digital assistant when invoked by 
the user. The user utilizes a stylus to select a particular keyboard character. 
Unfortunately, when the software keyboard is displayed, the user experiences a 
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marked reduction in the amount of space, on the touch-sensitive electronic display 
device, available to display data. 

The company SOFTAVA has developed the product Silkyboard as a solution for 
5 the perceived problems with the handwriting recognition device. The Silkyboard 
includes a keyboard template that is positioned over the handwriting recognition 
device. Thus, a user can tap on the appropriate location on the keyboard template to 
select and input a particular keyboard character. Moreover, the user can stroke 

o 

~ characters on the keyboard template, causing the handwriting recognition device to 

JTk) detect and to recognize the stroked characters as particular alphanumeric characters 

O 

pj or particular analog characters. However, the Silkyboard has several disadvantages. 

CD 

s First, the user finds it cumbersome, distracting, error-prone, difficult, and unintuitive to 

O 

y stroke characters over the keyboard template. Secondly, the user becomes 

^ dependent on the keyboard template rather than learning and employing the 

T5 productivity enhancements of the handwriting recognition device, preventing the user 
from fully experiencing the power of the handwriting recognition device. 

In addition, the company FTLab has developed the product ThumbType as a 
solution for the perceived problems with the handwriting recognition device. The 
20 ThumbType includes a special sheet having keyboard keys molded from a high- 
precision plastic and arranged with an approximate 6 millimeter (mm) pitch on the 
special sheet. The special sheet is positioned over the handwriting recognition 
device. The ThumbType is designed so that the user holds the personal digital 
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assistant in both hands and types using both thumbs. If the user desires to employ the 
handwriting recognition features of the handwriting recognition device, the 
ThumbType enables the user to display the handwriting recognition feature on the 
touch-sensitive electronic display device of the personal digital assistant. Thus, the 
5 user can stroke characters on the touch-sensitive electronic display device rather than 
on the handwriting recognition device, causing the handwriting recognition device to 
detect and to recognize via the touch-sensitive electronic display device the stroked 
characters as particular alphanumeric characters or particular analog characters. 

Q 

Besides the disadvantages discussed in connection with the Silkyboard, the 

51 

jTjO ThumbType also has the disadvantage that the handwriting recognition feature 
l^j displayed on the touch-sensitive electronic display device further reduces the 
5 productivity space available for the user on the touch-sensitive electronic display 
Si device and interferes with normal viewing of the data displayed on the touch-sensitive 

y electronic display device. 

O 
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SUMMARY OF THE INVENTION 

A data input device having multi-functional capability is described. In an 
embodiment, an electronic system includes the data input device. The electronic 
system is implemented as a personal digital assistant. The data input device includes 
a data input surface which is touch-sensitive. In addition, the data input device 
includes a removable template positioned over the data input surface. The data input 
device detects and facilitates recognition of a gesture performed by a user on the data 
input device. The removable template divides the data input surface into a first 
variable template input area and a second variable template input area. In an 
embodiment, the first variable template input area comprises a handwriting recognition 
input area for detecting and facilitating recognition of one or more first gestures while 
the second variable template input area is configured to detect and facilitate 
recognition of one or more second gestures. The first and second variable template 
input areas can be implemented as any type of template. 

Thus, the data input device can support multiple data input methods by 
enabling a user to change the removable template. Moreover, by enabling the user to 
change the removable template, the data input device is able to operate and control 
multiple devices which are integrated into the electronic system. For example, the first 
and second variable template input areas can be a keyboard template, a television 
remote control template, a telephone dialing panel template, or an electronic game 
control template. 
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In another embodiment, a removable data input device includes a data input 
surface which is touch-sensitive. An electronic system includes the removable data 
input device. The electronic system is implemented as a personal digital assistant. 
The removable data input device detects and facilitates recognition of a gesture 
performed by a user on the removable data input device. The data input surface 
includes a first variable template input area and a second variable template input area. 
In an embodiment, the second variable template input area comprises a handwriting 
recognition input area for detecting and facilitating recognition of one or more first 
gestures while the second variable template input area is configured to detect and 
facilitate recognition of one or more second gestures. The first and second variable 
template input areas can be implemented as any type of template. 

In this embodiment, the user changes the removable data input device in order 
to operate and control any one of a plurality of devices which are integrated into the 
electronic system or in order to change the data input methods available to the user. 
For example, a first removable data input device has a variable template input area 
implemented as a keyboard template, a second removable data input device has a 
variable template input area implemented as a television remote control template, a 
third removable data input device has a variable template input area implemented as 
a telephone dialing panel template, and a fourth removable data input device has a 
variable template input area implemented as an electronic game control template. 



PALM-3184/ACM/JSG 



-7- 



CONFIDENTIAL 



1 




These and other advantages of the present invention will no doubt become 
apparent to those of ordinary skill in the art after having read the following detailed 
description of the preferred embodiments which are illustrated in the drawing figures. 

5 In one embodiment, the present invention includes a data input device 

comprising: a data input surface for detecting a gesture performed thereon by a user 
and for facilitating recognition of the gesture as corresponding to a particular data 
Q input; and a user removable template positioned over the data input surface for 

s.a , a 

01 dividing the data input surface into a first data input area and a second data input area, 

WO wherein the first data input area is configured to facilitate recognition of one or more 

J]J first gestures, and wherein the second data input area is configured to facilitate 

5 s : 

!~ recognition of one or more second gestures. 

£ 

s s 

p In another embodiment, the present invention includes an electronic system 

O 

15 comprising: a processor; a bus coupled to the processor; an electronic display device 
coupled to the bus; a memory device coupled to the bus; and a data input device 
coupled to the bus, the data input device comprising: a data input surface for detecting 
a gesture performed thereon by a user and for facilitating recognition of the gesture as 
corresponding to a particular data input, and a user removable template positioned 

20 over the data input surface for dividing the data input surface into a first data input area 
and a second data input area, wherein the first data input area is configured to 
facilitate recognition of one or more first gestures, and wherein the second data input 
area is configured to facilitate recognition of one or more second gestures. 
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BRIEF DESCRIPTION OF THE DRAWINGS 



The accompanying drawings, which are incorporated in and form a part of this 
specification, illustrate embodiments of the invention and, together with the 
description, serve to explain the principles of the present invention. 

Figure 1 A illustrates a front view of a handheld electronic system in which 
embodiments of the present invention can be practiced. 

Figure 1B illustrates a logical circuit block diagram of a handheld electronic 
system in which embodiments of the present invention can be practiced. 

Figure 1C illustrates a network environment, including a handheld electronic 
system coupled to a host computer system and the Internet via a cradle device, in 
which embodiments of the present invention can be practiced. 

Figure 2 illustrates a front view of a handheld electronic system of Figure 1 A, 
showing the removable template and the first and second variable template input 
areas in accordance with an embodiment of the present invention. 

Figure 3 illustrates a handheld electronic system, showing a method for securely 
positioning the removable template in accordance with another embodiment of the 
present invention. 
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Figure 4 illustrates a plurality of removable data input devices in accordance with 
a second embodiment of the present invention. 

(/? a Figure 5 illustrates a method of coupling a removable data input device to a 
5 handheld electronic system in accordance with an embodiment of the present 
invention. 



y = 

H 



o 



Figure 5B is a flow chart illustrating a method of operating the removable 
template with the handheld electronic system in accordance with an embodiment of 
0 the present invention. 

Figure 5C is a flow chart illustrating a method of operating the removable data 
input device with the handheld electronic system in accordance with an embodiment 
of the present invention. 



H5 



Figure 6 illustrates a front view of a handheld electronic system, showing one of 
the variable template input areas implemented as a keyboard template in accordance 
with an embodiment of the present invention. 



20 Figure 7 illustrates a front view of a handheld electronic system, showing one of 

the variable template input areas implemented as an application shortcut launcher 
template in accordance with an embodiment of the present invention. 
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Figure 8 illustrates a front view of a handheld electronic system, showing one of 
the variable template input areas implemented as an electronic game control template in 
accordance with an embodiment of the present invention. 

Figure 9 illustrates a front view of a handheld electronic system, showing one of 
the variable template input areas implemented as a music keyboard template in 
accordance with an embodiment of the present invention. 

Figure 10 illustrates a front view of a handheld electronic system, showing one 
of the variable template input areas implemented as a television remote control 
template in accordance with an embodiment of the present invention. 

Figure 11 illustrates a front view of a handheld electronic system, showing one of 
the variable template input areas implemented as a telephone dialing pad template in 
accordance with an embodiment of the present invention. 

Figure 12 illustrates a front view of a handheld electronic system, showing one 
of the variable template input areas implemented as an application interface template 
in accordance with an embodiment of the present invention. 
20 

The drawings referred to in this description should not be understood as being 
drawn to scale except if specifically noted. 
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DETAILED DESCRIPTION OF THE INVENTION 

Reference will now be made in detail to the preferred embodiments of the 
present invention, examples of which are illustrated in the accompanying drawings. 
While the invention will be described in conjunction with the preferred embodiments, it 
will be understood that they are not intended to limit the invention to these 
embodiments. On the contrary, the invention is intended to cover alternatives, 
modifications and equivalents, which may be included within the spirit and scope of 
the invention as defined by the appended claims. Furthermore, in the following 
detailed description of the present invention, numerous specific details are set forth in 
order to provide a thorough understanding of the present invention. However, it will be 
recognized by one of ordinary skill in the art that the present invention may be 
practiced without these specific details. In other instances, well known methods, 
procedures, components, and circuits have not been described in detail as not to 
unnecessarily obscure aspects of the present invention. 

A VARIABLE TEMPLATE INPUT AREA 
Although the present invention will be discussed in connection with a handheld 
electronic system (e.g. a personal digital assistant), the present invention can be 
practiced with any other type of electronic system/computer system. 

Flgtrre-4^A^!]ust rates a front view of a handheld electronic system in which 
embodiments of the presentiment^ be practiced. In an embodiment, the 
handheld electronic system comprises a personaT^Jrgitalassistant 100. According to 
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Jin embodiment of the present invention, the personal digital assistant 100 is 
implemented as a clamshell configuration as disclosed in the pending patent 
applicatJc*jTLEXIBLE FORM-FACTOR PORTABLE COMPUTER SYSTEM" (SERIAL 

NO. filed on May 24, 2000 by E. Michael Lunsford, Bruce Woodworth, 

John Cook, and AmyN^an, assigned to the assignee of the present patent application), 
which is incorporated heretnJDy reference. 

As illustrated in Figure 1A, the personal digital assistant 100 includes an 
electronic display module 10 and a handwriting recognition module 20. The electronic 
display module 10 and the handwriting recognition module 20 are compact and well- 
suited to rest on a hand of a user. Moreover, the personal digital assistant 100 further 
includes a hinge 60. 

Specifically, the electronic display module 10 includes an electronic display 
device 30 for displaying visual data. It should be understood that the electronic 
display device 30 can be implemented in any manner. For example, the electronic 
display device 30 can be implemented as a liquid crystal display (LCD) screen (e.g., a 
color liquid crystal display, a monochrome liquid crystal display, etc.) or can be 
implemented as a light emitting diode (LED) display (e.g., a color LED display, a 
monochrome LED display, etc.). In an embodiment, the electronic display device 30 is 
implemented as a touch-sensitive electronic display device 30 which can detect a 
position of an object (e.g., a stylus) contacting a surface of the touch-sensitive 
electronic display device 30. 
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Moreover, the handwriting recognition module 20 includes a data input device 
40. In a preferred embodiment of the present invention as illustrated in Figure 1 A, the 
data input device 40 is configured to occupy a substantial portion of the handwriting 
recognition module 20 by increasing the size of the data input device 40. The 
clamshell configuration facilitates implementation of the present invention without 
negatively impacting one of the most important features of the personal digital 
assistant 100: compact size. If the present invention is implemented in a personal 
digital assistant which is configured as a single module, the length of the personal 
digital assistant would have to be increased to accommodate the present invention, 
reducing the appeal of the personal digital assistant to a variety of users. 

Figure 1 A illustrates a default configuration for the data input device 40. In an 
embodiment, the data input device 40 includes a data input surface 42. Moreover, the 
data input device 40 is configured to receive user input handwriting stroke data, 
whereas a user utilizes a stylus to stroke alphanumeric characters on the data input 
device 40. In an embodiment, the data input device 40 includes a first region 40A for 
receiving user input handwriting stroke data corresponding to a plurality of alphabetic 
characters. Moreover, the first region 40A also receives user input handwriting stroke 
data corresponding to a plurality of analog characters (e.g., *, &, @, $, etc.). In an 
embodiment, the data input device 40 includes a second region 40B for receiving user 
input handwriting stroke data corresponding to a plurality of numeric characters. Also, 
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the second region 40B receives user input handwriting stroke data corresponding to a 
plurality of analog characters (e.g., *, &, @, $, etc.). 

In addition, the data input device 40 includes a plurality of third regions 41A-D 
for invoking a particular function (e.g., to launch a particular application, to navigate 
through the stored applications, etc.) by tapping with the stylus. Furthermore, the 
handwriting recognition module 20 includes a plurality of function buttons 50 for 
selecting information or causing the personal digital assistant 100 to implement 
particular functions (e.g., to invoke a telephone address application, a calendar 
application, a to-do-list application, a memo pad application, etc.). 

As illustrated in Figure 1A, the personal digital assistant 100 includes an 
infrared communication port 75 for communicating via any infrared protocol and a 
serial communication port 70 for communicating with another electronic system (e.g., a 
host computer system) via a communication connection utilizing a serial protocol (e.g., 
a wireless serial connection, a wired serial connection, etc.). Moreover, the serial 
communication port 70 facilitates synchronizing the data stored in the personal digital 
assistant 100 with the data stored in a host computer system (See Figure 1C). 

Figure 1B illustrates a logical circuit block diagram of a handheld electronic 
system (e.g., personal digital assistant 100) in which embodiments of the present 
invention can be practiced. 
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The personal digital assistant 100 includes an address/data bus 1 10 for 
communicating information, a central processor 101 coupled with bus 110 for 
processing information and instructions, a volatile memory 102 (e.g., random access 
memory RAM) coupled with the bus 1 10 for storing information and instructions for the 
central processor 101 and a non-volatile memory 103 (e.g., read only memory ROM) 
coupled with the bus 1 10 for storing static information and instructions for the 
processor 101. The personal digital assistant 100 can also include a data storage 
device 104 ("disk subsystem") such as a magnetic or optical disk and disk drive 
coupled with the bus 1 10 for storing information and instructions. Data storage device 
104 can include one or more removable magnetic or optical storage media (e.g., 
diskettes, tapes) which are computer-readable memories. Memory units of the 
personal digital assistant 100 can include volatile memory 102, non-Volatile memory 
1 03 and data storage device 1 04. 

The personal digital assistant 100 can further include a signal generating device 
108 (e.g., a wireless network interface card "NIC", a serial communication port, an 
infrared (IR) communication port, a radio frequency (RF) communication port, etc.) 
coupled to the bus 1 10 for interfacing with other computer systems or electronic systems. 
The personal digital assistant 100 can also include an alphanumeric input device 106 
including alphanumeric and function keys coupled to the bus 110 for communicating 
information and command selections to the central processor 101. The alphanumeric 
input device 1 06 can be implemented as a data input device in accordance with 
embodiments of the present invention. The personal digital assistant 100 can also 
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include a cursor control or directing device 107 coupled to the bus 1 10 for 
communicating user input information and command selections to the central processor 
101. 

5 A display device 105 can also be coupled to the bus 1 10 for displaying information 

to the computer system/electronic system user. Display device 105 may be a liquid 
crystal device, other flat panel display, light emitting diode display, cathode ray tube, or 

^_ other display device suitable for creating graphic images and alphanumeric characters 

£3 

tfj recognizable by the user. The cursor control device 107 allows the user to dynamically 

Li. 

signal the two dimensional movement of a visible symbol (cursor) on a display screen of 

D 

nj display device 105. Many implementations of cursor control device 107 are known in the 

fn 

s art including a trackball, mouse, touch pad, joystick, a stylus, or special keys on 

O 

si alphanumeric input device 106 capable of signaling movement of a given direction or 

£ E 

r~* 

y manner of displacement. Alternatively, it will be appreciated that a cursor can be directed 
T5 and/or activated via input from alphanumeric input device 106 using special keys and 

key sequence commands. It should be understood that the personal digital assistant 100 

can be implemented in any other manner. 

Figure 1C illustrates a network environment 151, including a handheld 
20 electronic system (e.g., personal digital assistant 100) coupled to a host computer 
system and the Internet via a cradle device, in which embodiments of the present 
invention can be practiced. 
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Network environment 151 comprises a host computer system 156 which can 
either be a desktop computer system as shown, or, alternatively, can be a laptop 
computer system 158. Optionally, more than one host computer system 156 can be 
used within network environment 151. Host computer systems 158 and 156 are 
shown connected to a communication bus 154, which in one embodiment can be a 
serial communication bus, but could be of any of a number of well known designs 
(e.g., a parallel bus, Ethernet Local Area Network (LAN), etc.). In an embodiment, bus 
154 can provide communication with the Internet 152 using a number of well known 
protocols. 

Importantly, bus 154 is also coupled to a cradle 160 for receiving and initiating 
communication with the personal digital assistant 100. Cradle 160 provides an electrical 
and mechanical communication interface between bus 154 (and any device coupled to 
bus 1 54) and the personal digital assistant 1 00 for two-way communications. The 
personal digital assistant 100 also contains a wireless infrared communication 
mechanism 164 for sending information to other devices and for receiving information 
from other devices. 

Figure 2 illustrates a front view of a handheld electronic system (e.g., personal 
digital assistant 100) of Figure 1A, showing the removable template 51, the first 
variable template input area 51 A, and the second variable template input area 51 B in 
accordance with an embodiment of the present invention. The present invention 
enables the data input device 40 to have a plurality of easy to use and intuitive data 
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input methods that will appeal to users or potential users who dislike or who are 
unenthusiastic about the handwriting recognition features of the data input device 40, 
without obscuring a portion of the electronic display device 30. Moreover, the present 
invention enables the data input device 40 to operate and control any one of a plurality 
of devices that are integrated into the personal digital assistant 100, increasing the 
versatility of the personal digital assistant 100. 

In an embodiment of the present invention, the data input device 40 (viewable 
in Figure 1A) includes a data input surface 42 (viewable in FigurelA) and a removable 
template 51 positioned over the data input surface 42 (viewable in FigurelA). The 
data input surface 42 is touch-sensitive. Moreover, the data input surface 42 detects a 
gesture performed by a user on the data input surface 42. The user can perform the 
gesture with an object (e.g., a stylus) or without the object. The gesture should be 
understood to be any movement performed by the user to represent a particular data 
input entry (e.g., an alphanumeric character, selection of a particular application or 
function, etc.) for the handheld electronic system (e.g., personal digital assistant 100). 
Tap, drag, push, double tap, hop, zig-zag, and handwriting strokes are some examples 
of gestures. Moreover, the data input surface 42 facilitates recognition of the gesture 
performed by the user as corresponding to a particular data input (e.g., an 
alphanumeric character, selection of a particular application or function, etc.). In 
addition, the data input device 40 cooperates with hardware or software incorporated 
into the personal digital assistant 100 to process the gesture and to determine the 
particular data input intended by the user. 
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As illustrated in Figure 2, the removable template 51 of the present invention 
divides the data input surface 42 (viewable in FigurelA) into a first variable template 
input area 51 A and a second variable template input area 51B. In an embodiment, the 
first variable template input area 51 A comprises a handwriting recognition input area 
51 A that is configured to detect and to facilitate recognition of one or more first 
gestures corresponding to a plurality of handwriting strokes, whereas the user 
performs the handwriting strokes with an object (e.g., a stylus). 

Resembling the default configuration of the data input device 40 as illustrated in 
Figure 1A, the handwriting recognition input area 51 A includes a first region 40A for 
detecting and facilitating recognition of user input handwriting stroke data 
corresponding to a plurality of alphabetic characters. Moreover, the first region 40A 
also detects and facilitates recognition of user input handwriting stroke data 
corresponding to a plurality of analog characters (e.g., *, &, @, $, etc.). In addition, the 
handwriting recognition input area 51 A includes a second region 40B for detecting 
and facilitating recognition of user input handwriting stroke data corresponding to a 
plurality of numeric characters. Also, the second region 40B detects and facilitates 
recognition of user input handwriting stroke data corresponding to a plurality of analog 
characters (e.g., *, &, @, $, etc.). Furthermore, the handwriting recognition input area 
51 A includes a plurality of third regions 41 A-D for invoking a particular function (e.g., to 
launch a particular application, to navigate through the stored applications, etc.) by 
performing a particular gesture with the stylus. 



PALM-3184/ACM/JSG 



-20- 



CONFIDENTIAL 



Moreover, the second variable template input area 51 B is configured to detect 
and to facilitate recognition of one or more second gestures (e.g., tap, drag, push, 
double tap, hop, zig-zag, handwriting strokes, etc.) performed by the user on the 
second variable template input area 51 B. The second variable template input area 
51 B can be implemented as any type of template for indicating to a user the location 
on the touch-sensitive data input surface 42 (viewable in FigurelA) in which to perform 
the second gesture (e.g., tap, drag, push, double tap, hop, zig-zag, handwriting 
strokes, etc.) in order to execute a particular data input entry. For example, the second 
variable template input area 51 B may have figures to indicate the location on which to 
tap with a stylus in order to execute a data input entry corresponding to an 
alphanumeric character. 

The removable templates 251A-251C of Figure 2 are examples. The 
removable template 251 A includes a handwriting recognition input area 250A and a 
variable template input area implemented as a keyboard template 260A. The 
removable template 251 B includes a handwriting recognition input area 250B and a 
variable template input area implemented as an electronic game control template 
260B. The removable template 251 C includes a handwriting recognition input area 
250C and a variable template input area implemented as an application shortcut 
launcher template 260C. 



PALM-3184/ACM/JSG 



-21- 



CONFIDENTIAL 



It should be understood that the discussion with respect to the first variable 
template input area 51 A is applicable to the second variable template input area 51 B 
(e.g., the second variable template input area 51 B can be implemented as a 
handwriting recognition input area). It should be understood that the discussion with 
respect to the second variable template input area 51 B is applicable to the first 
variable template input area 51 A (e.g., the first variable template input area 51 B can 
be implemented as a keyboard template, an electronic game control template, an 
application shortcut launcher template, or etc.). 

Since the removable template 51 can be removed and replaced by a user, the 
data input device 40 is able to support multiple data input methods (e.g., handwriting 
recognition data input and keyboard data input), allowing the user to enter data using 
the data input method that appeals to the user based on the user's experience and 
comfort. In addition, a user that prefers to use the handwriting recognition feature or a 
user that has become proficient in using the handwriting recognition feature can utilize 
the default configuration of the data input device 40 (Figure 1A) without the removable 
template 51, affording the user a larger first region 40A (Figure 1A) and a larger 
second region 40B (Figure 1A) for improved productivity and for allowing the user to 
perform gestures that are more reflective of the user's natural handwriting strokes. 
Rather than being limited to one type of data input method, the user experiences the 
opportunity to determine the data input method to be utilized from a plurality of data 
input methods. 
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Moreover, a user can utilize the data input device 40 to operate and control 
multiple devices that are integrated into the personal digital assistant 100 by changing 
the removable template 51 having the variable template input area 51 B. Therefore, 
the removable template 51 increases the versatility of the data input device 40 and the 
personal digital assistant 100, as well as facilitates integration of multiple devices (e.g., 
telephone, television remote control, electronic music instrument, etc.) into the 
personal digital assistant 100 despite the space and size limitations of the personal 
digital assistant 100. 

In addition, the variable template input areas 51 A and 51 B may be implemented 
as an application interface template (e.g., enabling the user to invoke a particular 
application feature) for a particular application executable on the personal digital 
assistant 100. Thus, each application of a plurality of applications has a 
corresponding removable template 51. When a user desires to utilize a particular 
application, the user installs the corresponding removable template 51 on the data 
input device 40. In practice, the developer of an application creates the application 
and designs a removable template 51 having a variable template input area (e.g., the 
first variable template input area 51 A or the second variable template input area 51 B) 
capable of functioning as the application interface template for the application created 
by the developer, opening the development of an unlimited variety of removable 
templates 51 by developers for the user of the personal digital assistant 100. 
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Moreover, the removable template 51 facilitates manufacturing improvements. 
The variable template input areas 51 A and 51 B can be implemented as a QWERTY- 
type of keyboard template or as any type of keyboard template. Rather than spending 
resources in manufacturing multiple models of the personal digital assistant 100 
having foreign-language physical keyboards, a variable template input area (e.g., the 
first variable template input area 51 A or the second variable template input area 51 B) 
is implemented as a foreign-language keyboard template (e.g., Japanese keyboard 
template, German keyboard template, French keyboard template, Russian keyboard 
template, etc.). Hence, the user is able to switch from an unfamiliar keyboard template 
to a more familiar keyboard template simply by changing the removable template 51 , 
appealing to a greater number of users and potential users of the personal digital 
assistant 100. The costs of manufacturing the removable template 51 are substantially 
lower than the costs of manufacturing multiple models of the personal digital assistant 
100. 

In sum, the removable template 51 provides the user the opportunity to 
selectively configure the personal digital assistant 100 to reflect his/her lifestyle, 
whether business, family, or pleasure. 

In an embodiment, the removable template 51 is composed of mylar. The 
removable template is opaque to hide the default configuration (Figure 1A) of the data 
input device 40. It should be understood that the removable template can be made 
from another material. According to an embodiment, on each removable template 51 



PALM-3184/ACM/JSG 



-24- 



CONFIDENTIAL 



the third region 41 A is located in the upper left-hand corner of the handwriting 
recognition module 20 and is configured to enable the user to invoke a function which 
enables the user to view the applications, functions, or features available in the 
personal digital assistant 100. Thus, the user is ensured access to the function which 
enables the user to view the applications, functions, or features available in the 
personal digital assistant 100. 

In practice, the user securely positions the removable template 51 over the data 
input surface 42 (viewable in Figure 1 A) of the data input device 40. Thereafter, the 
user invokes a template calibration application corresponding to the removable 
template 51 to calibrate the data input device 40 having the removable template 51. 

In an embodiment, the removable template 51 is securely positioned over the 
input surface 42 (Figure 1A) by inserting the edges of the removable template 51 
under the top frame 25 of the handwriting recognition module 20. 

Figure 3 illustrates a handheld electronic system (e.g., a personal digital assistant 
100), showing a method for securely positioning the removable template 51 in 
accordance with another embodiment of the present invention. The removable template 
51 (having the handwriting recognition input area 51 A and the variable template input 
area 51 B) is positioned over the default configuration of the data input device 40. The 
top frame 25 of the handwriting recognition module 20 is positioned over the removable 
template 51 . Moreover, the top frame 25 includes one or more holes 23 for coupling the 
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top frame 25 to the handwriting recognition module 20 with one or more screws 21. The 
removable template 51 is securely positioned on the data input device 40 to avoid 
disrupting the calibration of the of the data input device 40 and to increase the 
accurateness and reliability of the data input device 40. 

Figure 4 illustrates a plurality of removable data input devices 440-440C in 
accordance with a second embodiment of the present invention. The discussion 
regarding the removable template in connection with Figure 2 is also applicable to the 
removable data input devices 440-440C. Moreover, the second embodiment of the 
present invention is practiced with a personal digital assistant 100 (Figure 5) having a 
handwriting recognition module 20 (Figure 5) configured to receive the removable data 
input device 440-440C. Each removable data input device 440-440C is configured to 
enable a user to remove the removable data input device from the personal digital 
assistant or to replace the removable data input device with another removable data 
input device. 

In this embodiment, the removable data input device 440 is the default 
configuration and includes the handwriting recognition input area 445 as discussed with 
respect to Figure 1A. Moreover, each of the removable data input devices 440A-440C 
includes a data input surface which is touch-sensitive, whereas the data input surface 
includes a first variable template input area 450A-450C comprising a handwriting 
recognition input area 450A-450C and a second variable template input area 460A- 
460C. The handwriting recognition input area 450A-450C is configured to detect and to 
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facilitate recognition of one or more first gestures corresponding to a plurality of 
handwriting strokes, whereas the user can perform the handwriting strokes with a stylus. 
Moreover, the second variable template input area 460A-460C is configured to detect 
and to facilitate recognition of one or more second gestures (e.g., tap, drag, push, double 
tap, hop, zig-zag, handwriting strokes, etc.) performed by the user on the second variable 
template input area 460A-460C with a stylus or without a stylus. The second variable 
template input area 460A-460C can be implemented as any type of template for 
indicating to the user the location on the touch-sensitive data input surface in which to 
perform the second gesture (e.g., tap, drag, push, double tap, hop, zig-zag, handwriting 
strokes, etc.) in order to execute a particular data input entry. 

The removable data input device 440A includes a second variable template input 
area 460A implemented as a keyboard template. The removable data input device 440B 
includes a second variable template input area 460B implemented as a telephone 
dialing pad template. The removable data input device 440C includes a second variable 
template input area 460C implemented as an electronic game control template. 

It should be understood that the discussion with respect to the first variable 
template input area 450A-450C is applicable to the second variable template input area 
460A-460C (e.g., the second variable template input area 460A-460C can be 
implemented as a handwriting recognition input area). It should be understood that the 
discussion with respect to the second variable template input area 460A-460C is 
applicable to the first variable template input area 450A-450C (e.g., the first variable 
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template input area 450A-450C can be implemented as a keyboard template, an 
electronic game control template, a telephone dialing pad template, or etc.). 

In an implementation, the data input surface of the removable data input device 
includes markings (e.g., figures) to identify the handwriting recognition input area and the 
variable template input area. The markings can be formed by etching, painting, pasting, 
or in any other manner. Alternately, a template is irremovably coupled to the data input 
surface to identify the handwriting recognition input area and the variable template input 
area. 



Since the removable data input device 440A-440C can be removed and 
replaced by a user, the personal digital assistant is able to support multiple data input 
methods (e.g., handwriting recognition data input and keyboard data input), allowing 
the user to enter data using the data input method that appeals to the user based on 
the user's experience and comfort. In addition, a user that prefers to use the 
handwriting recognition feature or a user that has become proficient in using the 
handwriting recognition feature can utilize the default configuration of the removable 
data input device 440, affording the user a larger first region 40A and a larger second 
region 40B for improved productivity and for allowing the user to perform gestures that 
are more reflective of the user's natural handwriting strokes. 

Moreover, a user can utilize the removable data input device 440A-440C to 
operate and control multiple devices that are integrated into the personal digital assistant 
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by changing the removable data input device 440A-440C having the first and second 
variable template input areas. Therefore, the removable data input device 440A-440C 
increases the versatility of the personal digital assistant and facilitates integration of 
multiple devices (e.g., telephone, television remote control, electronic music instrument, 
etc.) into the personal digital assistant despite the space and size limitations of the 
personal digital assistant. 

Each removable data input device 440-440C includes an electrical mechanism 
470-470C for enabling an electrical connection between the removable data input device 
and the personal digital assistant. Moreover, each removable data input device 440- 
440C includes a mechanism for automatically configuring the personal digital assistant to 
recognize the removable data input device when the removable data input device is 
coupled to the personal digital assistant. This mechanism obviates the need for the user 
to go through a configuration application which prompts for the description of the 
removable data input device or to go through a calibration procedure upon switching a 
first removable data input device for a second removable data input device. In an 
implementation, the mechanism comprises a mechanical part 480-480C that varies 
among the removable data input devices 440-440C. The personal digital assistant 
determines which removable data input device 440-440C is coupled to the personal 
digital assistant according to the location of the mechanical part 480-480C. Alternatively, 
the electrical mechanism 470-470C provides an electrical signal to the personal digital 
assistant to identify the removable data input device 440-440C which is coupled to the 
personal digital assistant. 
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Figure ^illustrates a method of coupling a removable data input device 440C to 
a handheld electronic system (e.g., a personal digital assistant 100) in accordance 
with an embodiment of the present invention. The removable data input device 440C 
(having the handwriting recognition input area 450C and the variable template input 
area 460C) is inserted into the handwriting recognition module 20. Alternatively, the 
removable data input device 440C can be slid into the handwriting recognition module 
20. It should be understood that the removable data input device 440C can be 
coupled to the handwriting recognition module 20 in any manner. 



Figure 5B is a flow chart illustrating a method 500B of operating the removable 
template with the handheld electronic system (e.g., a personal digital assistant 100) in 
accordance with an embodiment of the present invention. At step 505B, the user 
installs the removable template on the data input device of the personal digital 
assistant 100. At step 51 0B, the user selects a template calibration application 
corresponding to the removable template. At step 515C, the template calibration 
application guides the user through the calibration process for calibrating the data 
input device to operate properly while having the removable template. 

Figure 5C is a flow chart illustrating a method 500C of operating the removable 
data input device with the handheld electronic system (e.g., a personal digital assistant 
100) in accordance with an embodiment of the present invention. At step 505C, the 
user installs the removable data input device into the personal digital assistant 100. At 
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step 51 OC, the personal digital assistant proceeds through a configuration process in 
order to operate properly with the removable data input device, whereas the 
configuration process includes recognizing the type of removable data input device 
installed. 

Figure 6 illustrates a front view of a handheld electronic system (e.g., a personal 
digital assistant 100), showing one of the variable template input areas implemented 
as a keyboard template 51 B in accordance with an embodiment of the present 
invention. The personal digital assistant 100 includes an electronic display module 10 
and a handwriting recognition module 20. The handwriting recognition module 20 
includes a handwriting recognition input area 51 A and a variable template input area 
implemented as a keyboard template 51 B. It should be understood that the keyboard 
template 51 B can be implemented within one of the variable template input areas of 
the removable template (Figure 2) in accordance with the first embodiment of the 
present invention and can be implemented within one of the variable template input 
areas of the removable data input device (Figure 4) in accordance with the second 
embodiment of the present invention. 

In practice, the user utilizes a stylus to tap on the figure (on the keyboard 
template) corresponding to the keyboard character the user desires to select. It should 
be understood that the user can perform a gesture other than a tap to make his/her 
selection. Moreover, the keyboard template can be implemented as a Japanese 
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keyboard template, a German keyboard template, a French keyboard template, a 
Russian keyboard template, etc. 

Figure 7 illustrates a front view of a handheld electronic system (e.g., a personal 
digital assistant 100), showing one of the variable template input areas implemented as 
an application shortcut launcher template 51 B in accordance with an embodiment of the 
present invention. The personal digital assistant 100 includes an electronic display 
module 10 and a handwriting recognition module 20. The handwriting recognition 
module 20 includes a handwriting recognition input area 51 A and a variable template 
input area implemented as an application shortcut launcher template 51 B. It should be 
understood that the application shortcut launcher template 51 B can be implemented 
within one of the variable template input areas of the removable template (Figure 2) in 
accordance with the first embodiment of the present invention and can be implemented 
within one of the variable template input areas of the removable data input device (Figure 
4) in accordance with the second embodiment of the present invention. 

The application shortcut launcher template 51 B includes a plurality of application 
shortcuts 53. Each application shortcut 53 invokes a corresponding application. In an 
embodiment, the application shortcuts 53 are individually programmable by the user. In 
another embodiment, the application shortcuts 53 are automatically programmed to 
correspond to a predetermined number of previously invoked applications. Hence, the 
application shortcuts 53 can automatically adjust to the application usage habits of the 
user. In practice, the user utilizes a stylus to tap on the application shortcut 53 (on the 
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application shortcut launcher template 51 B) corresponding to the application the user 
desires to select. It should be understood that the user can perform a gesture other than 
a tap to make his/her selection. 

Figure 8 illustrates a front view of a handheld electronic system (e.g., a personal 
digital assistant 100), showing one of the variable template input areas implemented as 
an electronic game control template 51 B in accordance with an embodiment of the 
present invention. The personal digital assistant 100 includes an electronic display 
module 10 and a handwriting recognition module 20. The handwriting recognition 
module 20 includes a handwriting recognition input area 51 A and a variable template 
input area implemented as an electronic game control template 51 B. It should be 
understood that the electronic game control template 51 B can be implemented within 
one of the variable template input areas of the removable template (Figure 2) in 
accordance with the first embodiment of the present invention and can be implemented 
within one of the variable template input areas of the removable data input device (Figure 
4) in accordance with the second embodiment of the present invention. 

The electronic game control template 51 B includes a plurality of electronic game 
controls 57. Each electronic game control 57 corresponds to a particular function (e.g., 
up, down, right, left, etc.) performed while playing an electronic game, whereas the 
electronic game is executed on the personal digital assistant 100 or is executed on 
another device connected (e.g., wireless connection, wired connection, etc.) to the 
personal digital assistant 100. In an embodiment, the user utilizes a stylus to tap on the 
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electronic game control 57 (on the electronic game control template 51 B) corresponding 
to the particular function the user desires to select. It should be understood that the user 
can perform a gesture other than a tap to make his/her selection. In another 
embodiment, the user utilizes a finger or thumb to push on the electronic game control 57 
(on the electronic game control template 51 B) corresponding to the particular function the 
user desires to select. 

Figure 9 illustrates a front view of a handheld electronic system (e.g., a personal 
digital assistant 100), showing one of the variable template input areas implemented 
as a music keyboard template 51 B in accordance with an embodiment of the present 
invention. The personal digital assistant 100 includes an electronic display module 10 
and a handwriting recognition module 20. The handwriting recognition module 20 
includes a handwriting recognition input area 51 A and a variable template input area 
implemented as a music keyboard template 51 B. It should be understood that the 
music keyboard template 51 B can be implemented within one of the variable template 
input areas of the removable template (Figure 2) in accordance with the first 
embodiment of the present invention and can be implemented within one of the 
variable template input areas of the removable data input device (Figure 4) in 
accordance with the second embodiment of the present invention. 

The music keyboard template 51 B includes a plurality of music keys 93. In 
practice, the user utilizes a stylus to tap on the music key 93 (on the music keyboard 
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template 51 B) the user desires to select. It should be understood that the user can 
perform a gesture other than a tap to make his/her selection. 

Figure 10 illustrates a front view of a handheld electronic system (e.g., a 
personal digital assistant 100), showing one of the variable template input areas 
implemented as a television remote control template 51 B in accordance with an 
embodiment of the present invention. The personal digital assistant 100 includes an 
electronic display module 10 and a handwriting recognition module 20. The 
handwriting recognition module 20 includes a handwriting recognition input area 51 A 
and a variable template input area implemented as a television remote control 
template 51 B. It should be understood that the television remote control template 51 B 
can be implemented within one of the variable template input areas of the removable 
template (Figure 2) in accordance with the first embodiment of the present invention 
and can be implemented within one of the variable template input areas of the 
removable data input device (Figure 4) in accordance with the second embodiment of 
the present invention. 

The television remote control template 51 B includes a plurality of television 
controls 94. In practice, the user utilizes a stylus to tap on the television control 94 (on 
the television remote control template 51 B) the user desires to select. It should be 
understood that the user can perform a gesture other than a tap to make his/her 
selection. Moreover, the personal digital assistant 100 is able to communicate with the 
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television via a communication port (e.g., an infrared communication port 75, a serial 
communication port 70, a radio frequency communication port (not shown), etc.). 

Figure 1 1 illustrates a front view of a handheld electronic system (e.g., a personal 
digital assistant 100), showing one of the variable template input areas implemented as a 
telephone dialing pad template 51 B in accordance with an embodiment of the present 
invention. The personal digital assistant 100 includes an electronic display module 10 
and a handwriting recognition module 20. The handwriting recognition module 20 
includes a handwriting recognition input area 51 A and a variable template input area 
implemented as a telephone dialing pad template 51 B. It should be understood that the 
telephone dialing pad template 51 B can be implemented within one of the variable 
template input areas of the removable template (Figure 2) in accordance with the first 
embodiment of the present invention and can be implemented within one of the variable 
template input areas of the removable data input device (Figure 4) in accordance with the 
second embodiment of the present invention. 

The telephone dialing pad template 51 B includes a plurality of telephone dialing 
keys 95. In practice, the user utilizes a stylus to tap on the telephone dialing key 95 (on 
the telephone dialing pad template 51 B) the user desires to select. It should be 
understood that the user can perform a gesture other than a tap to make his/her 
selection. Moreover, the personal digital assistant 100 is able to communicate with the 
telephone line system via a communication port (e.g., an infrared communication port 75, 
a serial communication port 70, a radio frequency communication port (not shown), etc.). 
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Figure 12 illustrates a front view of a handheld electronic system (e.g., a 
personal digital assistant 100), showing one of the variable template input areas 
implemented as an application interface template 51 B in accordance with an 
embodiment of the present invention. The personal digital assistant 100 includes an 
electronic display module 10 and a handwriting recognition module 20. The 
handwriting recognition module 20 includes a handwriting recognition input area 51 A 
and a variable template input area implemented as an application interface template 
51 B. It should be understood that the application interface template 51 B can be 
implemented within one of the variable template input areas of the removable template 
(Figure 2) in accordance with the first embodiment of the present invention and can be 
implemented within one of the variable template input areas of the removable data 
input device (Figure 4) in accordance with the second embodiment of the present 
invention. 

The application interface template 51 B includes a plurality of application 
interface features 96, whereas the application interface features 96 are unique to the 
corresponding application. As described above, each application interface template 
51 B has a corresponding application. The application interface template 51 B 
facilitates an interface between the corresponding application and the user. Figure 12 
illustrates, as an example, an application interface template 51 B corresponding to a 
medical application. For example, the application interface template 51 B has 
application interface features 96 which enable the doctor to raise and lower the 
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patient's bed, which provide the vital signs of the patient, which provide the medical 
history of the patient, and which provide the prescription history of the patient. 

In practice, the user utilizes a stylus to tap on the application interface feature 
(on application interface template 51 B) the user desires to select. It should be 
understood that the user can perform a gesture other than a tap to make his/her 
selection. Moreover, the personal digital assistant 100 is able to communicate with 
another device or appliance via a communication port (e.g., an infrared 
communication port 75, a serial communication port 70, a radio frequency 
communication port (not shown), etc.). 

The foregoing descriptions of specific embodiments of the present invention 
have been presented for purposes of illustration and description. They are not 
intended to be exhaustive or to limit the invention to the precise forms disclosed, and 
obviously many modifications and variations are possible in light of the above 
teaching. The embodiments were chosen and described in order to best explain the 
principles of the invention and its practical application, to thereby enable others skilled 
in the art to best utilize the invention and various embodiments with various 
modifications as are suited to the particular use contemplated. It is intended that the 
scope of the invention be defined by the Claims appended hereto and their 
equivalents. 
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